<!DOCTYPE html>
<html lang="en">
<head>
  <meta http-equiv="Content-Type" content="text/html; charset=UTF-8"/>
  <meta name="viewport" content="width=device-width, initial-scale=1, maximum-scale=1.0"/>
  <title>MiVOS Project Website</title>

  <!-- CSS  -->
  <link href="https://fonts.googleapis.com/icon?family=Material+Icons" rel="stylesheet">
  <link href="css/materialize.css" type="text/css" rel="stylesheet" media="screen,projection"/>
  <link href="css/style.css" type="text/css" rel="stylesheet" media="screen,projection"/>
</head>
<body>
  <nav class="blue lighten-2" role="navigation">
    <div class="nav-wrapper container">
    </div>
  </nav>
  <div class="section no-pad-bot" id="index-banner">
    <div class="container">
      <br><br>
      <h5 class="header center blue-text text-darken-2">Modular Interactive Video Object Segmentation: <br> Interaction-to-Mask, Propagation and Difference-Aware Fusion</h5>
      <div class="row center">
        <h5 class="header col s12 light">Video Results 
          (<a href="https://www.youtube.com/playlist?list=PLmjJpH-Cd_GglzG2zUoWD3m5aXiVJxrqo">Full Playlist</a>)</h5>
      </div>
      <div class="row center">
        <div class="col s12 m4 l4 center top-btn">
          <a href="#parta" 
          class="btn-large waves-effect waves-light blue lighten-4 black-text">(a) DAVIS interaction track results</a>
        </div>
        <div class="col s12 m4 l4 center top-btn">
          <a href="#partb"
          class="btn-large waves-effect waves-light blue lighten-4 black-text">(b) Real user-interaction processes</a>
        </div>
        <div class="col s12 m4 l4 center top-btn">
          <a href="#partc" 
          class="btn-large waves-effect waves-light blue lighten-4 black-text">(c) Real user-interaction results</a>
        </div>
      </div>
    </div>
  </div>


  <div class="container">
    <div class="section" id="parta">
    <div class="divider"></div>
      <h5> (a) DAVIS interaction track results </h5>

      <p class='short_desc'>
        Results from ATNet are extracted from their open-sourced code. 
        Interactions are provided by the official DAVIS evaluation robot.
      </p>

      <div class="row center">
      <div class="col s12"><figure>
        <!-- https://youtu.be/ZgIzV7a03Pk -->
        <video preload="auto" autoplay muted loop class="videoInsert">
          <source src="https://i.imgur.com/dTAUy9H.mp4" type="video/mp4">
          Your browser does not support the video tag.
        </video>
        <figcaption><i>bmx-trees, DAVIS 2017 validation set.</i></figcaption>
      </figure>
      <div class="short_divider" ></div></div>

      <div class="col s12"><figure>
        <!-- https://youtu.be/5uwRrbFFxdI -->
        <video preload="auto" autoplay muted loop class="videoInsert">
          <source src="https://i.imgur.com/Iz9k3nW.mp4" type="video/mp4">
          Your browser does not support the video tag.
        </video>
        <figcaption><i>kite-surf, DAVIS 2017 validation set.</i></figcaption>
      </figure>
      <div class="short_divider" ></div></div>

      <div class="col s12"><figure>
        <!-- https://youtu.be/rfOUHcsgjks -->
        <video preload="auto" autoplay muted loop class="videoInsert">
          <source src="https://i.imgur.com/bQ7ycXU.mp4" type="video/mp4">
          Your browser does not support the video tag.
        </video>
        <figcaption><i>pigs, DAVIS 2017 validation set.</i></figcaption>
      </figure>
      <div class="short_divider" ></div></div>

      <div class="col s12"><figure>
        <!-- https://youtu.be/DWx4J5ubpJo -->
        <video preload="auto" autoplay muted loop class="videoInsert">
          <source src="https://i.imgur.com/75ILuRU.mp4" type="video/mp4">
          Your browser does not support the video tag.
        </video>
        <figcaption><i>scooter-black, DAVIS 2017 validation set.</i></figcaption>
      </figure>
      <div class="short_divider" ></div></div>

      <div class="col s12"><figure>
        <!-- https://youtu.be/z3rEs4UIOp8 -->
        <video preload="auto" autoplay muted loop class="videoInsert">
          <source src="https://i.imgur.com/dv4V8f8.mp4" type="video/mp4">
          Your browser does not support the video tag.
        </video>
        <figcaption><i>soapbox, DAVIS 2017 validation set.</i></figcaption>
      </figure></div>

    </div>

      <div class="right-align">
      <a href="#top" 
          class="btn-small waves-effect waves-light blue lighten-4 black-text">Back to Top</a>
      </div>
      <br>
    </div>

    <div class="section" id="partb">
      <div class="divider"></div>
        <h5> (b) Real user-interaction processes </h5>
        <p class='short_desc'>
          These show the entire interaction process with our algorithm.
        </p>

        <div class="col s12"><figure>
          <!-- https://youtu.be/NE5CEjMH2Hc -->
          <iframe height="480" class="videoInsert" 
            src="https://www.youtube.com/embed/NE5CEjMH2Hc?autoplay=1&mute=1&showinfo=0&loop=1&playlist=NE5CEjMH2Hc">
          </iframe> 
          <figcaption>For objects with complex structure, 
            users can combine different interaction techniques (clicks, scribbles, local control) 
            to achieve accurate results.</figcaption>
        </figure>
        <div class="short_divider" ></div></div>

        <div class="col s12"><figure>
          <!-- https://youtu.be/sx-hSiylhPw -->
          <iframe height="480" class="videoInsert" 
            src="https://www.youtube.com/embed/sx-hSiylhPw?autoplay=1&mute=1&showinfo=0&loop=1&playlist=sx-hSiylhPw">
          </iframe> 
          <figcaption>Using clicks with f-BRS can be highly efficient in annotating objects with clear structure.</figcaption>
        </figure>
        <div class="short_divider" ></div></div>

        <div class="col s12"><figure>
          <!-- https://youtu.be/l3dgBCJu238 -->
          <iframe height="480" class="videoInsert" 
            src="https://www.youtube.com/embed/l3dgBCJu238?autoplay=1&mute=1&showinfo=0&loop=1&playlist=l3dgBCJu238">
          </iframe> 
          <figcaption>Scribbles and clicks can be used in conjunction easily.</figcaption>
        </figure></div>

        <div class="right-align">
          <a href="#top" 
              class="btn-small waves-effect waves-light blue lighten-4 black-text">Back to Top</a>
        </div>
        <br>
    </div>

    <div class="section" id="partc">
      <div class="divider"></div>
        <h5> (c) Real user-interaction results </h5>

        <p class='short_desc'>
          We experiment with the generalizability and robustness of our method by testing it on videos collected from the Internet. 
          Our method works well even outside of the DAVIS dataset.
        </p>

        <div class="col s12"><figure>
          <!-- https://youtu.be/-hS7nI8u0ws -->
          <video preload="auto" autoplay muted loop class="videoInsert">
            <source src="https://i.imgur.com/x97rNSI.mp4" type="video/mp4">
            Your browser does not support the video tag.
          </video>
          <figcaption>151 frames with 6 objects. User time: ~180s. 
            The two fighters have close to mirrored appearance.</figcaption>
        </figure>
        <div class="short_divider" ></div></div>

        <div class="col s12"><figure>
          <!-- https://youtu.be/ecA6L3PKcBc -->
          <video preload="auto" autoplay muted loop class="videoInsert">
            <source src="https://i.imgur.com/NmLyf9c.mp4" type="video/mp4">
            Your browser does not support the video tag.
          </video>
          <figcaption>216 frames with 4 objects. User time: just under 6 seconds!</figcaption>
        </figure>
        <div class="short_divider" ></div></div>

        <div class="col s12"><figure>
          <!-- https://youtu.be/8g4M1rNXNzw -->
          <video preload="auto" autoplay muted loop class="videoInsert">
            <source src="https://i.imgur.com/dE2iegA.mp4" type="video/mp4">
            Your browser does not support the video tag.
          </video>
          <figcaption>130 frames with 2 objects. User time: ~60s. 
            Thin structure like the legs of the chair can be well-captured.</figcaption>
        </figure>
        <div class="short_divider" ></div></div>

        <div class="col s12"><figure>
          <!-- https://youtu.be/COg_gjFyEb8 -->
          <video preload="auto" autoplay muted loop class="videoInsert">
            <source src="https://i.imgur.com/2g7fkjo.mp4" type="video/mp4">
            Your browser does not support the video tag.
          </video> 
          <figcaption>252 frames with 3 objects. User time: ~60s. 
            Interaction between moving objects does not pose a major challenge to our method.</figcaption>
        </figure>
        <div class="short_divider" ></div></div>

        <div class="col s12"><figure>
          <!-- https://youtu.be/Tqc88yx7WC8 -->
          <video preload="auto" autoplay muted loop class="videoInsert">
            <source src="https://i.imgur.com/BVIjd4M.mp4" type="video/mp4">
            Your browser does not support the video tag.
          </video>
          <figcaption>181 frames with 3 objects. User time: ~35s.
            All pandas look the same but we can still handle it efficiently.
          </figcaption>
        </figure>
        <div class="short_divider" ></div></div>

        <div class="col s12"><figure>
          <!-- https://youtu.be/rmf6fKc3hHg -->
          <video preload="auto" autoplay muted loop class="videoInsert">
            <source src="https://i.imgur.com/M2wEJAc.mp4" type="video/mp4">
            Your browser does not support the video tag.
          </video>> 
          <figcaption>168 frames with 1 object. User time: ~40s. Occlusion from objects with similar appearance is difficult to handle for iVOS methods.</figcaption>
        </figure>
        <div class="short_divider" ></div></div>

        <div class="col s12"><figure>
          <!-- https://youtu.be/gxooV2iIMbo -->
          <video preload="auto" autoplay muted loop class="videoInsert">
            <source src="https://i.imgur.com/j7vmp5C.mp4" type="video/mp4">
            Your browser does not support the video tag.
          </video>
          <figcaption>132 frames with 3 objects. User time: ~20s.</figcaption>
        </figure></div>

        <div class="right-align">
          <a href="#top" 
              class="btn-small waves-effect waves-light blue lighten-4 black-text">Back to Top</a>
        </div>
        <br>
    </div>
  </div>

  <footer class="page-footer blue">
    <div class="container">
      <div class="row">
        <div class="col l6 s12">
            <h5 class="white-text">Contact</h5>
            <p class="grey-text text-lighten-4">
                Ho Kei Cheng (<a href = "mailto: hkchengrex@gmail.com" style="color:#a6d9fc;">hkchengrex@gmail.com</a>)
            </p>
        </div>
      </div>
    </div>
    <div class="footer-copyright blue">
    </div>
  </footer>


  <!--  Scripts-->
  <script src="https://code.jquery.com/jquery-2.1.1.min.js"></script>
  <script src="js/materialize.js"></script>
  <script src="js/init.js"></script>

  </body>
</html>

<script>
    document.addEventListener('DOMContentLoaded', function() {
    var elems = document.querySelectorAll('.materialboxed');
    var instances = M.Materialbox.init(elems, {});
  });

  // Or with jQuery

  $(document).ready(function(){
    $('.materialboxed').materialbox();
  });
</script>